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INTRODUCTION 



The evaluation systems project for local schools 
within the State of Michigan is developmental in 
nature. It is aimed directly at the further develop- 
ment and trial of a system of evaluation for local 
programs of vocational education. It is the expressed 
purpose of this project to maximize the use of local 
personnel, local rcrources, consultant leadership, 
and related professional assistance. More specifically, 
the objectives of the project are as follows: 

1. To further try-out and demonstrate a system for 
the evaluation of vocational education on . the 
local level which originated in the Michigan 
Project on Evaluation of Local Programs of Voca- 
tional Education. 

2. To discover and/or devise neW or improved pro- 
cedures for local program evaluation. 

3. To establish a working environment in which 
learning of evaluation procedures for both local 
school personnel and potential leaders at state 
and national levels of vocational education can 
take place. 

4. To identify and describe the role of a consultant 
in program evaluation. 

5. To uncover situations that could be considered as 
potential research and development centers. 



RELATIONSHIP TO RESEARCH 
AND DEVELOPMENT PROGRAM 

The Research and Development Program in 
Vocational-Technical Education is based on the clin- 
ical approach. Local schools and school systems are 
involved as partners in the testing and try-out 
phases of theoretical constructs for curriculum, ad- 
ministrative patterns, teacher education, instruc- 
tional materials development and other aspects of 

vocational-technical education. 

The Evaluation Systems Project is one of three 
projects in the R & D Program which cut-across 
the several occupational fields in local vocational 
education programs. The two other projects are (1) 
The Shared-Time (Dual Enrollment) Concept for 
Implementing Area Vocational Education Programs 
and (2) The Rural School Project. 



The Evaluation Systems Project draws upon the 
staff resources available from the five vocational 
teacher education services represented m the R &U 
Program: Agriculture’, Home Economcs, Distribu- 
tive, Office and Industrial education. As the other 
projects in the R & D Program move into measure- 
ment and evaluation phases, the findings from the 
Evaluation Systems Project will be readily available 
for use or reference by the staff involved in those 

projects. 



BACKGROUND 



Interest in evaluation in vocational education 
has increased during recent years. At least three 
major factors have been identified as related to this 
increased interest: Larger dollar investments in edu- 
cation, strong demand by employers for highly 
skilled and technically trained workers, and unem- 
ployment and underemployment of a portion of the 
labor force. However, regardless of the reasons for 
the interest in evaluation, traditionally, evaluation 
in vocational education has seldom been approached 
as a staff function within the local school with con- 
cern for all of the occupational programs as an in- 
tegral part of the total school program. 

The 1963 Vocational Education Act contains 
the requirement that an evaluation be made in 1968. 
This, too, has been a stimulus to interest in and 
concern for evaluation. 

The traditional federal-state-local relationships 
in vocational education provide a arm basis for 
focusing on the local school as the starting point 
for evaluation. 



DESIGN OF THE STUDY 



This project is designed in such a way as to 
maximize the values of local school staff and citizen 
involvement, to place emphasis on goals and out- 
comes, and to encourage the development and im- 
plementation of a system for evaluation on a per- 
manent or continuing basis. The broad steps are 
indicated, but there is a provision for flexibility to 



supplement and modify these steps and the general 
procedures so as to adapt them to different sizes 
and types of local schools. 

The following steps constitute the general de- 
sign of the project. 

1 . Utilize the research and development staff in an 
advisory capacity on the project. 

2. Select 10 schools to participate in the project. 
Have a director or leader of the local evaluation 
project appointed in each of these schools. Pro- 
vide partial support for one research associate 
for released time in each school. 

3. Hold meetings in individual schools and a meet- 
ing of representatives from all prospective parti- 
cipating schools to: 

a. Discuss objectives of the project 

b. Plan for subsequent steps in getting the project 
underway 

c. Begin identification of areas of concern in local 
school situations and of possible activities for 
local evaluation projects. 

4. Conduct a workshop for all local directors and 
research associates from schools cooperating in the 
project. Utilize the Manual on Evaluation of 
Local Programs 1 . Employ short-time consultant 
help for the workshop. 

5. Hold conferences in each school as follow-up of 
the workshop: to help set local project objectives; 
to develop broad outlines and/or steps in each 
local project; and to plan for the organization of 
local school staff and resources for evaluation. 

6. Encourage each cooperating school to conduct 
workshops and/or staff conferences for training 
of local staffs in evaluation of vocational educa- 
tion programs. 

7. Appoint experienced vocational teachers as re- 
search assistants to serve in a consultant capacity 
to these cooperating schools and to assist the state 
project leader in related activities. Provide intern 
experiences for these assistants through the project 
that will he’p in developing their competencies as 
leaders in -valuation. 

•Harold M. Byram, “Evaluation of Local Vocational 
Education Programs - A Manual for Administrators, Teachers 
and Citizens”, Bureau of Research Services, East Lansing, 
Michigan, College of Education, Michigan State University, 
81 pp., September 1965. 



8. Utilize services of specialized consultants from the 
State Department of Education as needed, and to 
correlate with evaluation of the state program of 
vocational education. 

9. Hold progress report meetings of local directors 
and research associates. 

10. Assemble reports and other data from cooperating 
schools to determine extent to which practices 
have been adopted, and with what success, as 
well as to identify new or improved practices. 

11. Analyze records and other data from cooperating 
schools, and conduct depth interviews to further 
develop and/or evaluate a generalized procedure 
or system. 

12. Construct the role of consultant on evaluation 
through analysis of records kept on the evaluation 
project and through gathering and analysis of 
related data. 



ACTIVITIES AND PROGRESS 



SELECTION OF SCHOOLS. Ten schools were 
selected from an original list of 250 schools which 
had expressed interest in evaluation. The five cri- 
teria used to select the schools were: 

Have expressed a desire to evaluate its program with 
a view to improving it where necessary. This criterion 
was applied by announcing to all schools in Michi- 
gan the availability of the Manual on Evaluation of 
Local Programs. 

Have not less than 1500, nor more than 20,000 en- 
rolled in kindergarten through 12th grade. 

Have vocational education programs underway in at 
least three reimbursable fields. 

Come from a location such as to contribute to geo- 
graphical representativeness of the group of schools 
as a whole. 

Have administrators and faculty willing to cooperate 
in the project by assigning a staff member as local 
project director or leader, and by providing him 
working time and local travel to direct the project. 

SIZE OF SCHOOLS. The ten schools include 
three large schools, three medium schools and four 
small schools, as shown in Table 1. 
















Table 1 

SIZE OF PARTICIPATING SCHOOLS 



Size 

Classification 


K- 12 
Enrollment 


Name of 

School 


Large 


32,109 


Lansing 




16,755 


Waterford Township 




11,900 


Benton Harbor 


Medium 


8,340 


Alpena 




6,510 


Niles 




4,700 


Sault Ste. Marie 


Small 


2,675 


Hillsdale 




2,600 


Fremont 




2,460 


Corunna 




2,042 


Big Rapids 



VOCATIONAL PROGRAMS. Each of the ten 
schools has vocational education programs under- 
way in at least three reimbursable fields. Two of 
the ten schools have programs in five fields, as 
shown in Table 2. 

Table 2 

VOCATIONAL EDUCATION PROGRAMS IN 
THE TEN PARTICIPATING SCHOOLS 



Business Home Agricultural Industrial Cooperative 
School Education Economics Education Education Education 



Alpena x 


X 


X 


X 


X 


Benton Harbor x 


X 


X 


X 


X 


Big Rapids 


X 


X 




X 


Corunna x 


X 


X 




X 


Fremont 


X 


X 




X 


Hillsdale 


X 


X 


X 


X 


Lansing x 


X 




X 


X 


Niles x 


X 


X 




X 


Sault Ste. Marie 


X 


X 


X 


X 


Waterford Twp. x 


X 






X 



GEOGRAPHICAL LOCATION. The schools 
are scattered throughout the lower peninsula of 
Michigan and one school is located in the eastern 
part of the upper peninsula, as shown in figure 1. 

STATE DEPARTMENT OF EDUCATION 
ROLE. The State Department of Education con- 
sultants in vocational education have been used in 
advisory capacities in regard to selection of schools, 
and planning major activities of the project. In ad- 
dition, they have been participants in the workshops 
and conferences held on M.S.U. campus, contribut- 
ing significantly to the overall developmental goals 
of the project. 

MATERIALS DEVELOPED. The materials 
previously developed and made available to the 
cooperating schools include the Manual For Evalua- 
tion of Local Programs of Vocational Education. 

Also, a mimeograph, “A Suggestive Frame- 
work for Evaluation of Programs of Vocational 
Education In Public Schools,” together with a 
copy of the design of the project were made avail- 
able. Materials prepared and presented by speakers 
at the workshop also were made available to par- 
ticipating schools. Actually, no new instructional 
materials, as. such, have been prepared and made 
available to the schools, since they were not called 
for in the purposes and design of the project. A 
brief on interviewing techniques was produced. 

LEADERSHIP DEVELOPMENT ACTIVI- 
TIES. Workshops, conferences, and consultations 
at individual schools have been used to develop 
the evaluation capability of the local project lead- 
ers, the research associates in local schools, and 
the research assistants assigned to the project leader. 

A workshop of three and one-half days was held 
for the local project leaders and the research asso- 
ciates from each of the ten schools. Program parti- 
cipants included three persons from schools involved 
in the previous evaluation project; two staff mem- 
bers from the State Department of Education, and 
11 faculty members of Michigan State University. 
Attendance included 18 from the participating schools 
and three from the State Department of Education. 
A culminating activity was meetings by the three 
size-groups to begin development of plans for each 
local evaluation project. 

Following this workshop, and prior to the fall 
progress report meeting, 17 conferences were held 
with local leaders in nine of these schools. The 
local projects were officially started at or near the 




Figure 1 

SCHOOLS COOPERATING IN 
EVALUATION SYSTEMS PROJECT 

LEGEND 

Small Schools (1500- 2,999) • 
Medium Schools (3,000-9,999) • 

Large Schools (10,000-19,999) 
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end of the academic year in eight schools. In only 
four schools were the project leaders on duty during 
the summer. Since the faculties with whom they 
work also were not on duty during this time, the 
effective dates of launching the local evaluation 
projects were at or near the beginning of the 
academic year. 

One “Newsletter” oi the evaluation project 
has been published. The purpose of the newsletter 
is to keep the participating schools appraised of all 
activities within the total project — what other schools 
are doing; what the project leader is doing; and, 
what Michigan State University is doing. 

Consultant work by the project leader has been 
done beyond that mentioned in selecting and re- 
cruiting the schools in the project. Since the May 
workshop, and through November 17, consulting 
meetings were held with the leadership in 11 schools. 
Consultant meetings were held by research assistants 
on the project in four schools. 

ACTIVITIES BY PARTICIPA TING SCHOOLS. 
The kind and scope of activities already initiated in 
each of the ten schools reflects to a certain extent 
the local commitment to evaluation. Each school 
signed a memorandum of agreement (1) setting 
forth the nature of its commitment and (2) accept- 
ance of the terms of the project, and was asked to 
prepare a project plan containing the following 
elements: 

General purpose or over-all aim of the project 

Ways in which local staffs will be involved, including: 
orientation meeting, workshop or conference, and 
individual or group work. 

Activities under way that will be continued 

Kinds of things that will be studied 

Kinds of records that will be kept 

Kinds of consultant help needed 

Flow chart or schedule of activities of the project 

Plans have been received from all the schools. 
All schools have established a system for keeping 
records on the project. On October 27 the one-day 
progress report meeting held on campus was attend- 
ed by 18 representatives from the 10 schools and 
one from the associated school. Excerpts from the 



reports show the following activities underway or 
about to get underway: 

Staff committees established in all schools 

Advisory committees established or planned in seven 

schools 

Follow-up of former students in six schools 

Released time in two schools for teachers to contact 

business and industries 

Program descriptions in five schools 

Statements of philosophy and objectives in five schools 

Study of needs and/or interviews of employers in 
five schools 

Evaluation of physical facilities in three schools 

Evaluation of vocational guidance program in two 
schools 

Two schools are conducting in-service work- 
shops. One of these is on a credit basis and will be 
the vehicle by which the evaluative activities will 
be carried out. Other activities represented by onu 
school each are as follows: study of practical arts; 
study of general education in relation to Vocational 
Education; feasibility studies of a testing program, 
shared time, and student placement; evaluation of 
organizational pattern; departmental self-evaluation 
and faculty world-of- work newsletter. Three medium - 
size schools planned a joint meeting at one of the 
schools to study facilities and make an interim 
progress report. 

A leader in each cooperating school is keeping 
a log of activities. In addition, records arc being 
kept such as minutes of committee meetings, instru- 
ments and forms produced locally, local publicity, 
and records of activities conducted. 

RESEARCH ASSISTANT ACTIVITIES One 
of the objectives for this project is “To estab- 
lish a working environment in which learning of 
evaluation procedures for . . . potential leaders at 
state and national levels of vocational education 
can take place.” Four doctoral students have been 
associated with the project as Research Assistants. 
They have been involved in many activities such 
as planning conferences, helping develop evaluation 
instruments, reviewing the literature on evaluation 
and serving as consultants to the project schools. 
In their capacity as consultants they have worked 
with many of the schools, as shown in Table 3. 
(Note: Most of the research assistants had been 
on-the-job less than four months at the time this 
report was written.) 
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Table 3 

CONSULTANT SERVICES PROVIDED BY 
RESEARCH ASSISTANTS TO 
PROJECT SCHOOLS, FALL 1966 



School 


Area of Specialization 
Business Home 

Education Economics 


by Research Assistants 
Agricultural Industrial 

Education Education 


Alpena 






X 




Benton Harbor 








Big Rapids 


X 


X 


X 


X 


Corunna 


X 


X 


X 


X 


Fremont 










Hillsdale 


X 






X 


Lansing 


X 


X 




X 


Niles 






X 




Sault Ste. Marie 




X 




Waterford 








..... 



TENTATIVE CONCLUSIONS 



A general review of the accomplishments leads 
to the conclusion that through the project there has 
been a significant start toward: 

Development of local leadership capability for evalu- 
ation of local programs of vocational education. 



The adaptation of a general model of involvement 
for evaluation to local conditions. 

The development of leadership capability for potential 
state and national leaders in vocational education. 

There are variations in the nature of the local 
projects and progress made in the cooperating 
schools, as might be expected. The kinds of help 
given to these schools consisted mainly of assistance 
in the design of the local project plans; formulation 
of a philosophy and objectives for the local project; 
suggestions on staff and advisory committees; tech- 
niques of follow-up and instrumentation; and help 
with local decisions regarding directions and activi- 
ties. The progress report meeting of October 27 
showed that all schools were enthusiastic about the 
project and were looking for ways of doing better 
their part in it. 

PLANS FOR THE FUTURE 

Short-range and long-range plans have been 
made. Several activities have already been scheduled 
for the immediate future. 

1. Two more progress report meetings 

2. Consultant visits to schools 

3. Interim-report meetings for three schools 

4. Development of instruments to determine per- 
ceptions of local school personnel about the role 
of consultants 

5. Assembling and analyzing data from the records 
from local schools. 

Long-range plans are being developed around 
two broad areas: (1) Further replication and try-out 
and (2) dissemination of information, both within 
the state and nation. 
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